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ABSTRACT 

The  Sustainment  Management  Support  Project  (SMSP)  will  assist  Maritime  Systems  Division 
(MSD)  to  reduce  its  Logistics  Cost  of  Ownership  (LCOO)  of  maritime  assets.  To  achieve  this,  a 
suite  of  software  tools  is  being  developed  and  it  is  essential  that  the  tools  utilise  the  same  data 
sources  and  uniformly  report  their  results.  The  SM  SP  provides  the  required  common  framework 
for  the  software  tools.  The  SMSP  suite  of  tools  includes  data  collection  and  data  cleansing; 
Condition-Based  Maintenance  (CBM);  system  reliability  and  availability  analysis;  inventory 
management;  prediction  of  system  and  Royal  Australian  Navy  (RAN )  platform  performanceand 
costs  for  a  range  of  operational  profiles;  objectivedeci  si  on-making;  and  identifying  potential  and 
actual  throughput  problems  in  the  MSD  business  domain. 
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The  Sustainment  M  anagement  Support  Project 


Executi  ve  Su  mmary 

The  Sustainment  Management  Support  Project  (SMSP)  is  an  advanced  analysis  system 
being  developed  to  predict  future  sustainment  requirements.  It  will  assist  Royal 
Australian  Navy  (RAN)  capability  managers  to  make  informed  decisions  and  thereby 
allocate  available  resources  cost-effectively  in  relation  to  platform  readiness  and 
sustai  nabi  I  ity.  The  outcomes  wi  1 1  give  these  capabi  I  ity  managers  the  abi  I  ity  to  maxi  mi  se 
platform  capability  and  quantitatively  analysecapabi  I  ity  management  options  in  relation 
to  maintenance  and  sparing  policies  for  a  range  of  operational  scenarios. 

The  SMSP  tool  suite  provides  the  means  to  perform  calculations,  deductions  and 
predictions  in  support  of  capability  management,  based  on  a  disparate  body  of  facts, 
relationships  and  rules.  FigureA  shows  the  process  flow  within  theSM  SPtoachievethese 
calculations,  deductions  and  predictions. 

The  SMSP  includes  data  collection  and  data  cleansing;  Condition- Based  Maintenance 
(CBM );  system  reliability  and  availability  analysis;  inventory  management;  prediction  of 
system  and  RAN  platform  performance  and  costs  for  a  range  of  operational  profiles; 
objective  decision-making;  and  identifying  potential  and  actual  throughput  problems  in 
theMariti  me  Systems  Division  (MSD)  business  domain. 

Two  primary  features  of  theSM  SP  are  the:  Information  Portal  thatwill  ensurequal  ity  data 
input;  and  the  Reporting  Portal  that  will  provide  consistency,  timeliness  and  ease  of 
reporting,  including  a  reporting  functionality  that  can  be  customised  to  the  needs  of  all 
levels  in  the  chain  of  command  (seeFigureA). 

TheSM  SP  can  be  aligned  with  many  of  the  Fundamental  I  nputs  to  Capabi  I  ity  (FI  C)  and  in 
so  doing,  the SM SP  encompasses  much  of  MSD's  activity  requirements.  The SM SP  will 
also  contri  buteto  a  number  of  Product  and  Process  Support  areas  withi  n  the  RA  N  and  the 
Defence  Materiel  Organisation  (DMO). 

Thi  s  report  descri  bes  the  fundi  onal  ity  of  the  SM  SP,  i  nd  udi  ng  the  accompanyi  ng  fi  gure, 
and  its  contribution  towards  DMO  goals.  The  primary  purpose  of  the  SM  SP  is  to  assist 
M  SD  red  u  ce  i  ts  L  og i  sti  cs  C  ost  of  O  w  n er sh  i  p  ( L  C  O  O )  of  mar i  ti  me  assets.  To  ach  i  eve  th  i  s, 
the  suite  of  software  tools  described  within  this  report  is  required  and  it  is  essential  that 
the  tools  utilise  the  same  data  sources  and  uniformly  report  their  results.  The  SMSP 
provides  the  required  common  framework. 

The  potential  financial  savings  that  will  be  realised  when  theSM  SP  is  implemented  and 
operational  is  difficult  to  estimate.  Flowever,  non-financial  benefits  include:  improved 
governance  and  accountability;  improved  capability  management,  particularly  in  the 
reliability,  mai ntenance  and  support  of  platforms  and  systems;  and  improvements  in 
workforce  effi  ci  ency. 


Data  Layer _  Analysis  Layer  Reporting  Layer 
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Figure  A .  The  process  flow  within  the  Sustainment  M  anagement  Support  Project 
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1.  Introduction 


The  Defence  Materiel  Organisation  (DMO)  has  a  single  purpose  [1]: 

T  o  equip  and  sustain  the  A  ustralian  D  efence  Force. 

To  achieve  this  purpose,  DMO  has  defined  a  set  of  goals  to  achieve: 

The  DMO  is  committed  to  delivering  capability  and  through-life  sustainment  of  military 
equipment  on  time,  on  budget  and  to  the  required  capability,  safety  and  quality. 

This  report  describes  the  functionality  of  the  Sustainment  Management  Support  Project 
(SMSP),  which  contributes  towards  the  DMO  goals.  The  functionality  developed  and 
proposed  by  theSMSP  will  enabletheDMO  Systems  Program  Offices  (SPOs)  and  the  Royal 
A ustral i an  N  avy  (RA  N )  to  make i  nformed  deci si ons  and  thereby  al I ocateavai I abl e resources 
cost-effecti  vel  y  i  n  rel  ati  on  to  pi  atform  read  i  ness  and  sustai  nabi  I  ity.  The  outcomes  will  assi  st  i  n 
maximising  platform  capability  and  availability;  and  the  quantitative  analysis  of  capability 
management  opti  ons  i  n  rel  ati  on  to  mai  ntenance  and  spari  ng  pol  i  ci  es  for  a  rangeof  operati  onal 
scenarios. 


Sustai  nment  contri  butesto  RA  N  preparedness  and,  consequently,  towards  mi  litary  capabi  lity, 
thereby  enabling  Australia  to  exercise  military  power  [2].  Sustainment  is  defined  as  ‘the 
provision  of  personnel,  logistic  and  other  support  required  to  maintain  and  prolong  operations  or 
combat  until  successful  accomplishment  of  the  mission  or  the  national  objective'  [2],  Sustainment, 
therefore,  is  a  functional  component  of  Integrated  Logistics  Support  (ILS)  Management, 
Engineering  M  anagement  and  Inventory  Management  within  the  SPOs  [3],  Essential  to  the 
development  and  delivery  of  military  capability  are  the  Fundamental  Input  to  Capability 
(FIC)  and  it  is  the  FIC  shown  below  that  define  the  elements  of  sustainment: 

•  COM  -  Command  and  Management; 

•  MAJ  -  Major  Systems; 

•  SUP  -Supplies; 

•  SPT  -  Support; 

•  FAC  -Facilities; 

•  ORG  -  Organisation; 

•  COL  -  CollectiveTraining;  and 

•  PEO  -  People. 


At  the  same  time  in  the  Navy  Strategic  Plan  (NSP)  [4],  the  short  to  medium  term  RAN 
intentions  and  requirements  are  identified.  The  NSP  is  a  strategic  level  12  month  business 
plan,  with  a  three  year  outlook  after  the  date  of  issue,  that  addresses  the  priorities  and 
performance  management  frameworks  necessary  to  deliver  capability.  Through  the  NSP, 
resources  are  allocated,  priorities  assigned  and  detailed  progress  monitored.  Within  the  NSP, 
the  RAN  Strategy  Map,  Figure  1,  defines  the  performance  management  framework  to 
measure  the  progress  towards  achieving  RAN  priorities  and  delivery  of  capability.  Thatis,  the 
contri  bution  towards  the  N  avy's  Output.  The  N  avy's  Output  is  achieved  by  addressi  ng  the 
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RAN  goals.  The  RAN  goals,  shown  within  thebody  of  theRAN  Strategy  Map,  are  structured 
around  five  themes  with  each  theme  having  a  goal  centred  on  the  FIC.  The  RAN  goals  are: 

•  Leadership; 

•  Shape  Our  Future; 

•  Prepare  for  Operations; 

•  Build  Partnerships;  and 

•  People. 


Figure  1:  TheRAN  Strategy  M  ap  [4] 


Organisations  within,  or  aligned  to,  the  RAN  havetheir  own  Strategic  Plans  or  Maps  designed 
tocontributetowardstheRAN  Strategy  M  ap  and  NSP.  These  Strategic  Plans  and  Mapswere 
originally  used  to  identify  high  level  Project  and  Process  Sup  port  areas  with  in  DMO  and  the 
RAN  wheretheSMSP  would  contribute.  However, dueto the evolvingnatureoftheStrategy 
Maps  and  the  changing  priority  roles,  it  was  decided  not  to  linktheSMSP  directly  with  any 
Strategic  Plans.  Instead,  the  SMSP  was  aligned  with  the  FIC,  which  are  essential  to  the 
development  and  delivery  of  military  capability.  The  FIC  to  which  theSM  SP  contri bute  are 
shown  in  Figure  2.  The  arrow  in  Figure2  indicates  that  the  output  from  theSM  SP  contributes 
towards  DMO  mariti  me  logistics  in  support  of  RA  N  preparedness.  The  Support  A  reas  show 
five  of  the  eight  FIC  to  which  the  SMSP  contributes.  The  three  FIC  not  included  are 
Organisation,  CollectiveTraining  and  People. 
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Figure2:  TheFIC  to  which  theSM  SP  contribute 


TheprimaryaimoftheSMSPisto assi st M SD  red u ce i ts L ogi sti cs C ost of O w nersh i p ( L C 0 0 ) 
of  mari  ti  me  pi  atf  orms.  To  ach  i  eve  th  i  s,  a  su  i  te  of  softw  are  tool  s  i  s  requ  i  red  and  i  t  i  s  essenti  al 
that  these  tools  utilise  the  same  data  sources  and  uniformly  report  their  results.  TheSMSP 
i  nvol  ves  the  dev  el  opment  of  those  softw  are  tool  s  and  al  i  gns  them  i  n  a  common  framework. 


This  report  describes  the  functionality  and  process  flow  of  the  SMSP.  The  report  only 
describes  that  functionality  being  developed  for  theSM  SP.  It  is  beyond  the  scope  of  this  report 
to  describe  the  numerous  other  ILS  and  Reduced  Cost  of  Ownership  (RCOO)  related  tools 
being  developed  within  the  Defence  Science  and  Technology  Organisation  (DSTO). 


In  Section  2,  an  overview  of  the  SMSP  process  flow  is  presented  and  the  various  tools 
introduced.  Section  3  presents  the  Data  Layer,  which  ensures  accurate  and  quality  data  and 
mod  el  s  are  i  n  put  i  nto  vari  ou  s  su  pport  d  atabases.  The  D  ata  L  ay  er  al  so  faci  I  i  tates  the  extracti  on 
of  data  from  the  databases.  Secti  on  4  descri  bes  the  software  tool  s  i  n  theA  nalysis  L  ayer.  These 
toolsprovideanalysisin  such  areas  as  i  nventory  management,  maintenance  management  and 
business  processes.  Section  5presentstheReportingLayer  that  facilitates  prompt  and  consistent 
reporting.  Section  6  discusses  the  SMSP  in  relation  to  the  FIC  and  finally,  in  Section  7, 
concluding  comments  are  presented. 


2.  The  Sustainment  M  anagement  Support  Project 

The  SMSP  supports  the  efforts  and  the  conduct  of  the  RAN  Force-In-Being  (FIB),  thereby 
maintaining  the  fleet  at  a  specified  level  of  operational  capability.  Therefore,  supporting  the 
FIB  is  to  support  and  sustain  the  fleet  through  a  course  of  action  ata  prescribed  operational 
state: 
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Sustainment  The  provision  of  personnel,  logistic  and  other  support  required  to  maintain  and 
prolong  operations  or  combat  until  successful  accomplishment  of  the  mission  or  the 
national  objective.  [2] 

The  distinction  between  Sustainment  and  Sustainability,  in  a  military  context,  is  that 
Sustainability  is  the  peacetime  capacity  to  sustain  a  possible  future  military  operation  and 
Sustainment  is  to  sustain  an  operation  during  wartime  [5]. 


The  means  by  which  theSMSP  supports  the  FIB  is  shown  in  Figure  3.  This  is  the  top  level 
view  of  the  process  flow  for  theSMSP.  Functionality  has  been  developed  and  proposed  for 
each  oftheareas:  Data  Layer;  Anal  ysis  Layer;  and  the  Reporting  Layer.  Attheti  me  of  writing, 
somefuncti  onal  ity  sti  1 1  exi  sts  as  conceptual  i  deas;  somefuncti  onal  i  ty  is  i  n  prototypeform;  and 
some  functionality  is  being  trialled  at  the  conceptual  level  within  the  SPOs. 


The  arrows  within  Figure  3  indicate  the  output  each  layer  contributes  to  Sustainment 
Management  Support.  Thefunctionality  of  each  layer,  and  the  contribution  of  theSMSP  to 
RAN  sustainment  for  preparedness,  is  described  in  later  sections  of  this  report. 


Also,  the  arrows  within  thefigure,  and  any  subsequent  related  figures,  do  not  representthe 
total  i  ty  of  i  nformati  on  f  I  ow .  The  arrow  s  i  nd  i  cate  the  u  I  ti  mate  contri  buti  on  to  the  D  M  O  and  the 
RAN .  Within  each  layer,  there  may  be  i  nformati  on  feedback  to  previous  layers. 

The  Reporting  Layer  provides  for  easy  access  to  reports  and  results  of  analysis.  It  also 
facilitates  access  to  thefunctionality  within  the  Analysis  Layer.  Examples  of  functionality 
i  ncl  ude:  the  Predi  cti  ve  M  ateri  el  A  vai  I  abi  I  ity  and  Sustai  nabi  I  ity  Tool  (PM  A  ST)  for  i  nventory 
management;  and  EXAKT  for  maintenance  policy. 


Logistics  has  been  described  as  an  art  and  a  science  benefiting  from  facts,  relationships  and 
rules  used  for  calculation,  deduction  and  prediction  [6].  The  Analysis  Layer  of  theSMSP  is 
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primarily  where  the  logistics  science  is  performed.  That  is,  functionality  within  theAnalysis 
Layer  provides  for  the  calculations,  deductions  and  predictions.  Calculations  indudefailure 
probability  and  repair  rate  distributions;  deductions  include  maintenance  policy;  and 
predictions  include  inventory  management  or  system  failures. 

To  perform  the  calculations,  deductions  and  predictions,  a  body  of  facts,  relationships  and 
rules  are  required.  These  facts  (for  example:  maintenance  history  data),  relationships  (for 
example:  Reliability  Block  Diagrams  (RBDs))  and  rules  (for  example:  SPO  Business  Rules)  are 
usually  stored  within  a  database  or,  more  generally,  in  many  disparate  databases. 

The  anal  ysi  s  tool  s  send  data  requests  to  the  Data  Layer  for  specifi  c  data  needs.  The  D  ata  Layer 
'knows'  wherethat  data  exists  and  extractsitfromtheappropriatedatabase(s).  Functionality 
within  the  Data  Layer  ensures  that  quality  and  accurate  data  is  input  into  several  of  the 
related  logistics  databases,  especially  those  developed  for  the  SMSP.  The  Data  Layer  also 
performs  data  cleansing  and  data  aggregation. 

The  following  subsections  present  an  overview  for  each  layer. 


2.1  Data  Layer 


Data  quality  is  critical  for  data  analysis,  so  that  realistic  results,  conclusions  and 
recommendations  aregenerated.  The  Data  Layer  ensures  that  quality,  cleansed  and  integrated 
d  ata  i  s  avai  I  ableto  the  anal  ysi  stools.  Figure4showsthefunctionality  and  process  involved  in 
ensuring  data  quality. 
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Figure 4:  The  functionality  within  the  Data  Layer  oftheSM  SP 
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The  Support  Tools,  described  in  Section  3,  ensure  that  some  ILS  databases  contain  accurate 
and  detailed  information.  NotethattheSupportToolsaredesignedforspecificdatabasesand 
will  not  affect  data  recordi ng  for  every  I LS  database. 

The  Database  Layer  i  s  a  col  I  ecti  ve  grou  pi  ng  of  al  I  associ  ated  I  ogi  sti  cs  databases  that  contri  bute 
to  theSM  SP.  These  databases  do  not  necessari  ly  co-exist  on  the  same  computer  server  or  even 
in  the  same  physical  location.  They  are  disparate  and  owned  by  variousorganisationswithin 
theAustralian  DefenceOrganisation  (ADO).Thedatabaselayer ispurely  representational  and 
i  t  i  s  not  the  i  ntenti  on  of  the  SM  SP  to  col  I  ect  the  databases  i  nto  one  I  ocati  on  or  common  format. 

The  Information  Portal  isthelayer  that  interacts  directly  with  thedatabases;  it  isthe bridge 
between  the  Analysis  Layer  and  thedatabases.  The  Information  Portal  is  designed  to  receive 
requests  for  data  from  the  Analysis  Layer  and  then  extract  the  necessary  data  from  the 
relevant  databases.  When  the  Information  Portal  receives  the  data  it  will  then  perform  data 
cleansing  operations,  which  may  include  manual  data  cleansing  methods. 

U  ti  I  i  si  ng  the  I  nformati  on  Portal  avoi  ds  d  i  rect  i  nteracti  on  between  the  A  nal  ysi  s  Layer  and  the 
databases.  If  changes  were  to  occur  to  thedatabases,  those  changes  need  only  be  recognised 
by  the  Information  Portal  and  will  not  require  changes  to  all  the  analysis  tools  using  those 
databases.  The  Information  Portal  maintains  a  consistent  interface  with  the  Analysis  Layer 
and  provides  a  measure  of  security  si  nee  it  is  the  only  interface  accessing  thedatabases. 

2.2  Analysis  Layer 

The  Analysis  Layer  consists  of  a  collection  of  Analysis  Tools,  as  shown  in  Figure  5.  The 
Analysis  Tools  contribute  to  a  number  of  areas  across  ILS,  Engineering,  Repair  and 
Maintenance,  Inventory  Management  and  Governance'  Enabling.  This  is  discussed  further  in 
Section  4. 


Figure  5:  The  A  nalysis  Layer  showing  the  icons  for  theSM  SP  analysis  tools 
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2.3  Reporting  Layer 

The  results  from  the  Analysis  Layer  are  passed  to  the  Reporting  Layer,  which  contains  the 
Reporting  Portal.  In  this  layer,  the  information  is  presented  in  a  form  suitable  for  the  end 
users. 

The  overall  process  flow  fortheSMSP  isshown  in  Figure6(an  expanded  view  of  that  shown 
in  Figure3).Theintention  of  the  Reporting  Portal  isto  facilitate  access  to  thetools,  and  results 
of  data  analysis  by  the  DMO  (and  RAN)  chain-of-command.  In  so  doing,  the  SMSP 
contributes  towards  the  support  of  RAN  Preparedness  via  the  FIC  (shown  in  the  column 
Support  A  reas  on  the  extreme  right  of  Figure  6). 


Data  Layer 


Support 

Tools 


HDi 
-  ng t- 

1  A3  r 


RBDDT 


Accurate.  \ 
detailed, 
raw  data  & , 
models 


RCM 

Failure 

Mode 

Finder 


Analysis  Layer 


Reporting  Layer 


Support  Areas 


Figure  6:  The  overall  process  flow  for  theSM  SP 


3.  Data  Layer 

As  overviewed  in  Section  2,  the  Data  Layer  contains  the  Support  Tools  to  ensure  accurate, 
quality  data  and  models  are  input  into  the  respective  databases.  The  support  tools  are 
described  further  in  thefollowing  subsections. 

3.1  Reliability  Block  Diagram  Development  Tool 

An  RBD  schematically  represents  the  serial  and  parallel  relationships  between  systems, 
subsystems  and  components  requi  red  to  perform  a  given  function.  Furthermore,  thefunctions 
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can  be  aggregated  to  form  RBDs  representing  a  given  capability  requirement.  Simple,  two 
component  RBD  structures  are  shown  in  Figure  7. 


(a)  (b) 

Figure  7:  Two  simple  examples  of  RBDs.  Figure  (a)  represents  components  in  series;  and  Figure  (b) 
represents  components  in  parallel. 

Figure  7a  represents  a  system  of  two  components  in  series.  The  system  is  operational  only  if 
both  components  I  andj  are  operational.  If  either  I  orj  fails,  then  the  system  fails.  Figure  7b 
represents  a  system  of  tw  o  components  i  n  paral  I  el .  The  system  i  s  operati  onalifeitherXorYis 
operational.  If  X  fails,  or  if  Y  fails,  the  system  continues  to  operate.  If  both  X  and  Y  fail  then  the 
system  will  fail. 

After  identifying  systems  and  components  that  are  required  to  perform  a  function,  the  next 
stage  i  n  the  model  I  i  ng  process  is  to  defi  nethe states  of  each  system  or  component  i  n  the  RBD 
and  the  mechani  sm  of  transfer  between  thestates.  For  exampl  e,  thestates  i  nd  ude:  operati  onal ; 
failed  and  under  repair;  and  failed  and  waiting  for  a  spare  system  or  component.  The 
mechani  sms  of  transfer  include:  'operational'  to 'failed  and  under  repair';  'failed  and  waiting 
for  a  spare' to 'failed  and  under  repair';  and  'failed  and  under  repair' to 'operational'.  Each  of 
these  mechani  sms  of  transfer  may  havean  associated  probability  of  success.  The  relationships 
represented  by  the  RBDs  assi  st  i  n  the  anal  ysi  s  of  determi  ni  ng  whether  a  system  will  succeed 
or  fail  in  its  designed  function  or  capability. 

The  Reliability  Block  Diagram  Development  Tool  (RBDDT)  is  a  proposed  modulethat  will 
al  I  ow  RBD  d  evel  opers  to  easi  I  y  i  nput  RBD  s  vi  a  a  G  raphi  cal  U  ser  I  nterface  (GUI)  and  store  the 
RBD  as  a  directed  graph  [7].  The  tool  will  also  allow  for  entry  of  associated  details  such  as 
failure  modes,  probability  of  failure  and  repai r  ti mes  for  each  system  and  component. 

TheRBDDT  will  not  perform  data  analysis  and  will  notgenerateresults.TheRBDDT  database 
would  be  interrogated  by  the  analysis  tools  and  as  such  it  would  provide  input  to  those 
anal  ysi  stools. 

Data  supplied  by  the  RBDDT  would  include: 

•  system  confi  gurati  on; 

•  system  fai  I  u  re  mod  es; 

•  probabi I  ity  of  fail  ure;  and 

•  Mean TimeTo  Repair  (MTTR). 

The  RBDs  would  contribute  towards  determining  platform: 

•  serviceability; 
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•  configuration  status; 

•  operational  viability  of  the  components/  systems;  and 

•  materiel/ maintenance  support. 

3.1.1  Current  State 

RBDsthat  havecurrently  been  developed  for  RAN  platforms  are  stored  in  theClass  System 
Analysis  and  Reporting  Software  (CSARS)  database  [8].  CSARS  is  the  central  repository,  for 
each  platform  cl  ass,  of  all  platform  RBD  definitions.  It  also  facilitates  direct  I  inks  between  each 
RBD  component  and  the  same  component  i  n  the  Standard  Defence  Supply  System  (SDSS),  the 
Asset  M  anagementand  Planning  System  (AM  PS)  and  other  decision  support  systems.  As  the 
central  RBD  repository,  any  RBD  management  support  tool  must  access  the  RBD  definitions 
intheCSARS  database  dynamically,  without  manual  lyredrawing  them  in  proprietary  GUIs. 
The  dynamic  use  of  the  RBDs  in  the  CSARS  database  eliminates  potential  configuration 
management  problems  associated  with  RBD  updates  (such  as  avoiding  multipleversionsof 
thesameRBD  existing  in  several  different  commercial  softwarepackages).TheseRBDscould 
be  configuration  managed  by  the  SPOs  so  there  is  only  ever  one  RBD  definition  of  any 
platform  system.  This  also  removes  the  Intellectual  Property  (IP)  problem  of  several 
commerci  al  packages  havi  ng  to  access  each  other's  RBDs.  H  owever,  dueto  thecomplexity  of 
RBD  structu res,  stori  ng  them  i  n  a  hi  erarchi  cal  format  i  s  not  a  vi  abl  e sol  uti  on.  To  overcome thi  s 
they  must  be  converted  to  a  directed  graph.  The  CSARS  database  is  not  capable  of  storing  a 
directed  graph. 

3.1.2  Future 

Development  of  the  RBD  DT  would  commencewith  the  supporting  RBD  database  structure 
definition.  The  RBDDT  database  would  initially  support  PMAST  and  is  required  dueto 
I  i  mi  tati  ons  i  n  the  RBD  structure  i  ncorporated  wi  thi  n  CSA  RS.  Thecomponents  and  systems  of 
theRBD  structu  res  would  also  store  associated  platform  positional  information,  failure  modes 
and  system  functional  performance  degradation  in  the  case  of  subsystem  and  component 
failures. 

The  RBD  DT  database  woul  d  be  desi  gned  to  store  RBDs  as  di  reded  graphs.  T ool  s  such  as  the 
RBDDT  and  PMAST  would  then  have  the  capability  of  interpreting  the  di  reded  graphs. 

A  nother  asped  of  the  devel  opment  of  the  RBD  DT  i  nd  udes  consol  i  dati  ng  RBD  constructs  from 
military  standards  of  the  United  States  of  America  (USA)  and  the  United  Kingdom  (UK)  [9, 
10]  and  other  sources  such  as  the  International  Eledrotechnical  Commission  (IEC) 
International  Standard  [11]. 

Continued  development  of  the  RBDDT  would  provide  to  the  user  a  GUI  to  facilitate 
construdion  of  RBDs  using  'drag-and-drop'  techniques.  This  would  allow  the  user  to  easily 
visualise  the  RBD  on  thecomputer  screen.  The  underlining  di  reded  graph  algorithm  would 
ensure  all  RBDs  are  automatically  converted  and  would  maintain  a  standard  for  the  RBDs 
across  all  platform  classes. 
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Currently,  the  directed  graph  algorithm  has  been  developed  but  the  RBDDT  database 
def  i  n  i  ti  on  has  on  I  y  been  i  nf  ormal  I  y  sped  f  i  ed .  A  t  the  ti  me  of  w  ri  ti  ng,  f  u  rther  d  evel  op  ment  of 
the  RBDDT  has  ceased. 

3.2  Systems  I  nterface  U  nit 

A  necessary  requ  irement  for  Condi  ti  on- Based  Maintenance  (CBM)  modelling  istheneed  to 
access  real-ti  me,  onl  i  ne,  system  conditi  on  data.  Thecurrent  control  and  monitori  ng  system  on 
the  A  N  ZA  C  C I  ass  fri  gates  (FF  H )  i  s  capabl  e  of  I  oggi  ng  data  from  a  smal  I  nu  mber  of  sensors, 
which  is  then  stored  locally  on  removable,  magnetic  storage  devices.  FI  owever,  this  data  is 
incomplete  and  inaccessible  to  personnel  performing  advanced  analysis. 

A  control  and  monitoring  enhancement  project  has  developed  hardware  and  software,  known 
as  the  Systems  I  nterface  U  nit  (SI  U ),  to  extract  al  I  sensor  and  al  arm  data  from  the  FFFH  control 
and  monitoring  system.  The  data  collected  bytheSIU  istransferred  to  a  shore-based  database 
for  diagnostic  and  prognostic  analyses.  The  interface  between  the  SIU  and  the  shore-based 
mai  ntenance  systems  i  s  vi  a  satel  I  ite  and  uti  I  i  ses  a  web  browser  i  nterface,  known  as  the  CBM 
Toolkit.  An  image  of  the  SIU,  as  installed  on  FIMAS  Ballarat,  is  shown  in  Figure  8. 


Figure 8:  SIU  installation  on  HM  AS  Ballarat 

The  SIU  will  beused  to  provideconditi  on-monitoring  (sensor  and  alarm)  data  from  the  FFFH 
control  and  monitoring  system  (consisting  of  approximately  3500  sensors)  to  an  onshore 
control  and  monitoring  database  i  n  a  format  accessible  by  the  Data  Abstractor  (proposed  as  a 
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constituent  part  of  the  functionality  of  the  Information  Portal)  and/  ortheCBM  Toolkitfor 
post-processing. 

Analysisof  SIU  data  can  be  used  to  provide  information  on: 

•  esti mates  for  the  economic  consequences  of  fai lure; 

•  esti  mates  for  the  cost  of  repai  r; 

•  condition-monitoring  data  for  assessments  of  the  general  condition  of  systems; 

•  alarm  monitoring  data  for  assessments  of  the  fai  led  condition  of  systems; 

•  estimates  for  the  time  at  which  a  component  or  system  will  need  to  be  replaced  or 
repaired  based  on  its  current  risk  trend;  and 

•  estimates  for  the  likelihood  of  transitioning  from  a  low-risk  to  high-risk  state,  thus 
helping  maintenance  managers  quantify  the  risks  of  postponing  maintenance. 

Development,  testing  and  evaluation  of  the  SIU  is  dependent  on  support  from  a  number  of 
organisations,  including  theANZAC  SPO,  FFH  crews  (where  trials  are  being  conducted)  and 
control  and  monitoring  system  Original  Equipment  Manufacturer  (OEM)  contractors. 

Regular  transfer  of  maintenance  management  data  is  dependent  on  access  to,  and  successful 
transfer,  via  the  N A VSYSL AN  network  and  INMARSAT  satellite  links  to  the  shore-based 
Defence  Restricted  N  etwork  (DRN )  database. 

At  theti  me  of  writing,  an  initial  nine  month  trial  oftheSIU  has  occurred  on  FI  MAS  Ballarat, 
with  data  being  collected  during  that  time.  A  second  SIU  is  also  being  trailed,  this  time  on 
FIMASArunta;  however  the  trial  is  ongoing  due  to  third  party  warranty  issues. 

3.3  Maintenance  Analysis  and  InputTool  -  Data  Input 

The  Maintenance  Analysis  and  Input  Tool1  (MAIT)  [12,  13]  is  a  discrete  'product'  that 
provides  functionality  for  quality  data  input  and  data  analysis.  Thedata  input  functionality 
provides  quality  control  by  analysing  the  data  for  completeness  and  accuracy.  The  data 
analysi  s  aspect  of  M  A  IT  provi  des  support  for  rel  i  abi  I  ity,  avai  I  abi  I  ity  and  mai  ntai  nabi  I  ity.  For 
this  reason,  within  the  confines  of  this  report,  theMAIT  datainput  and  MAIT  data  analysis 
have  been  separated  into  two  distinct  parts.  Therefore  MAIT  data  input  is  considered  a 
Support  Tool  within  the  Data  Layer,  as  shown  in  Figure  6. 

The  Input  Tool  aspect  of  MAIT  has  been  developed  to  investigate  AM  PS  data  quality.  Prior 
investigations  had  determined  that  AMPS  data  quality  was  found  to  be  unsuitable  for 
engineering  and  costing  analysis.  It  was  discovered  that  the  user  interface  was  the  source  for 
much  of  these  issues.  MAIT  data  input  addresses  shortfalls  with  the  AM  PS  interface  and 
introduces  new  features  to  promote  the  col  lection  of  high  quality  maintenance  data. 

MAIT  datainput  utilises  data  validation  rules  and  provides  feedback  to  the  user  regarding 
possible  inconsistencies.  It  ensures  accurate  data  is  recorded  intheAM  PS  database.  MAIT  also 
provi  des  a  data  qual  ity  reporti  ng  fundi  on  that  analyses  data  records  agai  nst  an  expeded  I  evel 


1  MAIT:  formerly  known  as  the  Maintenance  Analysis  and  Input  Demonstrator  (MAID). 
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of  detail  and  reports  the  probability  of  the  record's  inaccuracy  or  if  the  record  contains  an 
i  nsuffi  ci  ent  I  evel  of  detai  I . 

3.4  Reliability  -  Centred  Maintenance  Failure  Mode  Finder 

Accurate  CBM  modelling  requires  knowledge  of  the  occurrence  of  failure  modes  and  for  a 
consistent  approach  to  the  assignment  of  failure  modes.  Unfortunately,  AM  PS  contains  data 
that  is  neither  complete  nor  accurate.  For  failure  data,  somedata  is  recorded  el  sew  here  other 
than  AMPS.  This  does  allow  for  manual  assignment  of  failure  modes  by  collating  and 
synthesising  thedata from thedisparate sources,  however  thescant  data  provided  i  n  A  M  PS  is 
all  that  is  avail  able  to  assist  in  assigning  failure  modes.  In  isolation,  this  would  generally  not 
be  sufficient  for  confident  diagnosis.  If  the  set  of  possible  failure  modes  was  significantly 
reduced  by  considering  the  event  in  an  appropriate  context,  an  experienced  engineer  or 
technician  may  possibly  make  a  reasonable  guess  of  the  likely  failure  mode.  Reliability 
Centred  M  aintenance  (RCM )  analysis  provides  this  context  and  fortunately,  for  many  FFH 
systems,  RCM  studies  have  been  conducted  and  the  data  stored  in  a  database. 

The  purpose  of  the  proposed  RCM  Failure  Mode  Finder  (FM  F)  is  to  provide  an  efficient 
method  of  assi  gni  ng  fai  I  u  re  modes  based  on  the  sparse  data  avai  I  abl  e  i  n  A  M  PS  and  w  i  1 1  al  I  ow 
for  subsequent  CBM  analysis.  The  RCM  FM  F  searches  through  RCM  databases  and  assists 
experi  enced  p  racti  ti  oners  to  make  qu  anti  tati  ve  d  eci  si  ons  on  probabl  efai  I  u  re  mod  es.  Th  i  s  w  i  1 1 
enabl  e  determi  nati  on  of: 

•  the  accu  rate  cl  assi  fi  cati  on  of  fai  I  u  res; 

•  th  e  total  n  u  m  ber  of  f ai  I  u  res; 

•  'what  if?'  assessments  of  modified  maintenance  policies  on  the  Operational 
Availability  (OA)  of  systems  and  platform  fundi  ons; 

•  the  costs  of  a  modified  maintenance  policy; 

•  theriskoffailureduring  upcoming  missions  and  thedependency  on  maintenance  to 
reduce  that  risk; 

•  manning/  support  requirements  of  a  modified  maintenance  policy;  and 

•  the  spares  required  to  reduce  risk  during  an  upcoming  mission. 

Data  cleansing  is  required  to  improve  the  reliability  of  the  RCM  FMF  search  engine.  The 
cleansing  involves  fixing  spelling  mistakes  and  referential  inconsistencies  in  the  RCM  and 
AM  PS  data  tables.  In  the  latter  case,  only  the  static  tables  such  as  the  facility  codes  and 
compartment  descriptions  have  been  repaired. 

For  real  time  performance,  the  cleansed  data  should  be  recorded  in  the  underlying  database. 
FI  owever,  there  is  reluctance  by  the  system  owners  to  modify  historical  AM  PS  data.  This 
results  in  a  significant  and  unnecessary  processing  burden  each  time  thedata  is  reused. 

Errors  i  n  A  M  PS  job  detai  Is  are  not  rectifi  ed  si  nee  these  need  to  be  taken  i  nto  account  when 
performing  the  search  and  new  jobs  arecontinuously  being  recorded.  Consequently,  it  is  only 
feasible  to  search  copies  of  the  various  data  sources,  rather  than  the  real  time  data,  si  nee  the 
results  of  data  cleansing  can  be  retained. 
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3.5  Databases 

The  Databases  section  of  the  Data  Layer  is  a  representation  only  of  thecollectivegrouping  of 
databases  accessed  by  the  SM  SP.  The  databases  that  the  Data  Layer  should  access  i  nd  ude: 

•  CSARS  [8]; 

•  Ships  Automated  Logistic  Information  Reporting  System  (SALIRS)  [14]; 

•  SDSS  [15]; 

•  AM  PS  [16]; 

•  AMPS/  Procurement  Automation  (AM  PS/ PA)  [17]; 

•  AMPS  Facilities  Maintenance  Management  System  (AMPS  FMMS)  [17]; 

•  Navy  Allowances  (NAVALLOW)  [14]; 

•  Capability  Analysis  Tool  (CAT)  [18]; 

•  Ship  Repair  Contracts  Office  Management  Information  System  (SRCO-M  IS)  [19]; 

•  Fleet  Activity  Management  Tool  (FAMT)  [20]; 

•  Personnel  Management  Key  Solution  (PM  KeyS)  [21]; 

•  Configuration  Management  Tool  (CMT)  [22]; 

•  RBDDT; 

•  PMAST[23,  24,  25]; 

•  Logistics  Analysis  Tool  (LAT);  and 

•  the  FFH  control  and  monitoring  database. 

3.6  Information  Portal 

The  Information  Portal  potentially  provides  a  single  interface  to  all  potential  data  sources, 
thereby  alleviating  the  problem  of  individual  analysis  tools  having  direct  links  with  the 
databases.  The  Information  Portal  consists  of  a  Data  Source  Abstractor  and  a  Data  Validator, 
as  descri bed  i n  thefol lowi ng  subsections. 

3.6.1  Data  Source  Abstractor 

The  Data  Source  Abstractor  potentially  providesasingleinterfacetoall  data  sources.  Security, 
connectivity  and  database  language  issues  are  managed  by  the  Data  Source  Abstractor.  The 
Data  Source  A  bstractor  outputs  col  I  ated  data  rel  ated  to  specifi  c  equi  pment  and  systems  as  per 
the  requi  rements  of  the  requesti  ng  analysi  s  tool . 

3.6.2  Data  Validator 

The  Data  Validator  outputs  cleansed,  verified  and  validated  data.  It  receives  collated  data 
from  the  Data  Source  A  bstractor  and  inspects  each  datum  in  context  to  determinewhetherthe 
datum: 

1.  isvalid; 

2.  can  be  corrected  automati  cal  I  y;  or 

3.  requ  i  res  h  u  man  i  nterventi  on . 

In  the  third  case,  the  datum  and  details  of  any  discrepancies  are  transmitted  back  to  the 
originator  for  timely  correction. 
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4.  Analysis  Layer 

TheAnalysis  Layer  iswherelogisticscalculations,  deductionsand  predictions  are  performed. 
The  Analysis  Layer  contri  butes  to  DMO,  and  RAN,  processes  in  the  areas  of  Engineering, 
Repair  and  Maintenance,  Inventory  Management,  Information  Management  and 
Governance/  Enabling,  as  shown  in  Figure  5. 

In  the  area  of  Governance/  Enabling,  theAnalysis  Layer  contributes  primarily  towards  the 
M  SD  Operati  ons  M  anagement  and  Fi  nance  sub  domai  ns  i  n  order  to  i  mprovedecision-maki  ng 
and  hence  improve  MSD  efficiency  and  effectiveness.  Research  is  focused  on  developing 
conceptual  models  representative  of  various  aspects  of  M  SD  business.  The  intention  is  for 
these  models  to  be  used  in  developing  a  range  of  practical  tools  and  data  constructs  that 
coalesces  contextual  information  from  operations,  management  and  finance  to  create 
synergies  within  the  Governance/  Enabling  sub  domains.  The  assumptions  associated  with 
this  research  are  that: 

•  al  I  rel evant  and  accurate  data  i s  avai  I abl  e;  and 

•  input  to  output  business  relationships  can  beunderstood  and  modelled. 

If  the  assumptions  are  maintained,  the  research  will  result  in  improved  business  decision¬ 
making. 

The  fol  I  ow  i  ng  su  bsecti  ons  d escr i  be  al  I  the  tool  s  w  i  th i  n  the  A  nal  y si  s  L ay er . 

4.1  Predictive  Materiel  Availability  and  Sustainability  Tool 

PM  AST  [23, 24, 25]  is  a  modelling  and  simulation  softwaretool  used  to  predict  theOA,  spares 
and  associ  ated  materi  el  costs  of  systems,  su bsystems  and  rol  es  (such  as,  'engage  ai  r  targets' ) 
for  a  range  of  RAN  platform  operational  profiles.  It  enables  theSPOs,  and  the  RAN, to  make 
i  nformed  deci  si  ons  and  thereby  al  I  ocate  avai  I  abl  e  resources  more  cost-effecti  vel  y  to  maxi  mi  se 
capabi  I  i  ty .  1 1  al  so  al  I  ows  for  quanti  tati  ve  anal  ysi  s  of  pi  atform  capabi  I  ity  management  opti  ons 
i  n  rel  ati  on  to  d  ifferent  mai  ntenanceand  spari  ng  pol  i  ci  es.  PM  AST  has  theabi  I  ity  to  model  such 
things  as:  multiplesystemsand  platforms;  correctiveand  preventive  maintenance;  platform, 
base  and  depotlevel  sparing;  and  rotatable  pool/  repairable  items  including  recyd  eti  mes  and 
failure,  repair  and  uncertainty  distributions  for  each  component. 

PM  AST  has  been  designed  to  answer  'what  if'  questions  in  relation  to  OA,  spares  and  costs 
such  as: 

•  What  if  roles  change? 

•  What  if  financial  resources  are  constrained? 

•  W hat  if  there  are  not  enough  on  board  spares? 

•  What  if  the  sustainment  period  changes? 

•  W hat  if  corrective  maintenance  is  not  performed? 

The  mathemati  cal  model  s  of  pi  atforms;  the  I  ogi  sti  cs  processes;  and  mai  ntenance  pol  i  ci  es  that 
have  been  implemented  within  PMAST  are  an  approximation  of  the  real  world.  To  limit 
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potential  misunderstandings  of  both  PM  AST  inputs  and  outputs,  it  is  important  that  all  the 
implementation  characteristics  and  assumptions  that  have  been  used  in  the  modelling  are 
documented.  The  modelling  limitations  and  assumptions  can  be  found  in  the  PMAST 
Modelling  and  Simulation  Characteristics  report  [24], 

For  the  SPOs,  the  potenti  al  outcomes  from  the  use  of  PM  AST  i  nd  ude  i  improvements  i  n  spares 
allocations  and,  therefore,  a  reduction  in  LCOO. 

4.2  Logistics  Anal y si s  Tool 

The  LAT  is  designed  to  perform  two  functions.  Firstly,  it  determines  the  failure  and  repair 
probability  distributions,  and  corresponding  95%  confidence  limits,  of  platform  components. 
The  second  function  is  to  extract,  from  multiple  sources,  data  that  includes:  the  Ships 
Allowance  List  (SAL);theStock  On  FI  and  (SO  FI);  times  to  supply;  and  component  costs.  This 
data  and  thesubsequent  LAT  output  isthen  made  avail  able  for  usewith  other  readiness  and 
sustainability  tools,  such  as  PMAST. 

The  LAT  has  an  associated  database  used  to  minimise  the  time  connected  to  multiple 
databases  over  the  DRN  and,  consequently,  reduce  the  potentially  large  usage  of  computer 
bandw  i  dth.  The  database  al  so  faci  I  itates  the  extracti  on  of  data  from  SDSS  so  that  SDSS  users 
do  not  experience  degraded  response  times.  Also,  the  LAT  only  requires  infrequent  use,  for 
exampleonceaweekor  oncea  month.  This  is  because,  temporally,  most  of  thedata  will  only 
undergo  marginal  changes.  As  a  result,  PMAST  processingtimewill  speed  up  si  nee  the  LAT 
need  not  be  used  every  time  PMAST  is  used. 

The  pri  mary  assumptions  associated  with  the  development  of  the  LAT  are  that: 

•  the  underlying  data  is  correct; 

•  all  failures  for  the  fitted  equipment  have  been  recorded  in  the  AM  PS  database; 

•  the  N  orth  Atl  anti  cT reaty  Organi  sati  on  I  tern  I  dentifi  cati  on  N  umber  (N 1 1 N )  i  ssues  data 
i  s  correct  for  each  faci  I  ity  code; 

•  the  primary  configuration  is  based  on  theCSARS  system; 

•  al  I  faci  I  ity  codes  required  for  PM  AST  have  a  M  ateriel  Support  Evaluation  (M  SE)  code; 

•  the  required  data  is  recorded  in  ADO  Logistics  Information  Systems  (LIS); 

•  all  relevant  information  stored  in  ADO  LIS  is  correct;  and 

•  thedata  is  Independently  and  Identically  Distributed  (I I D). 

The  benefits  of  the  LAT  include  calculations  such  as: 

•  repair  distributions; 

•  associated  uncertainty  in  the  repair  distributions; 

•  failure  distributions; 

•  associated  uncertainty  in  the  failure  distribution;  and 

•  logistics  delay  time,  such  as  base-to-depot,  base-to-platform  or  depot-to-platform. 
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4.3  M  AIT  Data  Analyser 

MAIT  was  developed  by  the  DSTO  in  response  to  an  investigation  of  data  quality  within 
A  M  PS.  The  i  nvesti  gati  on  found  that  A  M  PS  data  qual  ity  was  i  nsuffi  ci  ent  for  both  engi  neeri  ng 
and  costing  analysis.  MAIT  addresses  theseissues  and  introduces  new  features  to  promotethe 
collection  of  high  quality  maintenance  data.  MAIT  is  designed  to  be  used  with  the  current 
AM  PS  database  without  modification  and  provides  a  simple  web-browser  interface  for  the 
input  of  maintenance  data  and  its  analysis. 

MAIT  data  analysis  is  performed  in  support  of  reliability,  availability  and  maintainability 
analysis.  It  calculates  the  Mean  Time  Between  Failures  (MTBF);  cumulative  frequency 
distributions;  and  utilises  Wei  bull  and/  or  Exponential  distributions,  whereappropri  ate,  for 
the  analysis.  Feedback  is  also  provided  to  the  user  informing  them  of  the  quality  of  the 
analysis  and  indicates  the  degree  to  which  the  data  is  relevant,  accurate,  complete  and 
reliable. 

M  A  IT's  anal  ysi  s  capabi  I  i  ty  provi  des  the  mai  ntenance  engi  neer  w  i  th  avai  lability  and  reliability 
i  nformati  on  data  qual  ity  reports.  M  A  IT  can  al  so  can  provi  dethecurrent  status  of  a  pi  atform's 
systems,  based  on  mai  ntenance  that  requires  completion  that  affects  system  avai  I  ability.  The 
impact  of  future  scheduled  maintenance  is  also  taken  into  consideration  for  determining 
system  avai  I  ability. 

The  output  from  MAIT  includes: 

•  costs; 

•  required  resources; 

•  MTBF; 

•  MTTR;and 

•  platform  availability. 

4.4  EXAKT 

EXA  KT  i  s  a  C  BM  softw  are  tool ,  dev  el  oped  at  the  U  ni  versi  ty  of  T  oronto's  C  BM  I  aboratory,  for 
predicting  the  remaining  useful  life  of  a  platform  [26].  EXAKT  models  the  ages  of  previous 
potential  and  actual  failures  and  includes thecondition-monitoring  data  leading  up  to  those 
events.  It  takes  into  consideration  the  failure's  economic  consequences  and  generates  an 
optimal  policy  for  predicting  potential  failures.  A  Proportional-Flazards  Model  (PFIM)[27]is 
used  by  EXA  KT  to  joi  n  el  ements  of  cond  i  ti  on  data  and  fai  I  u  re  data  i  nto  a  si  ngl  e  ri  sk  fundi  on . 
The  PH  M  hazard  fundi  on  can  only  be  determi  ned  for  fai  lure  modes  with  associ  ated  hi  stori  cal 
data,  however,  dueto  the  numerical  and  theoretical  models  utilised  by  EXAKT,  only  a  small 
number  of  failures  are  required. 

EXAKT  is  a  form  of  decision  analysis  that  will  provide  added  fundionality  to  AMPS  by 
allowing  the  maintenance  manager  to  perform  'what  if'  type  calculations.  For  example,  a 
question  may  be,  ‘what  will  be  the  downtime/availability/reliability  cost  of  my  system  if  I 
double/triple/halve  the  overall  frequency  of  some  maintenance  activity?'  EXAKT  will  generate  a 
recommendation  supporting  a  stated  management  objedive.  These objedives  typically: 
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•  minimise  cost; 

•  maximise  the  platform's  avail  ability;  and 

•  achievea  particular  Key  Performance!  ndicator  (KPI),  for  example  ratio  of  planned  to 
breakdown  maintenance. 

EXAKT  provides  an  estimate  of: 

•  theeconomic  consequences  of  failure; 

•  the  cost  of  repair; 

•  costs  of  a  modified  maintenance  policy; 

•  the  time  to  repair  or  replacement  for  a  platform  based  on  its  current  risk  trend; 

•  the  likelihood  of  transitioning  from  a  low-risk  to  high-risk  state,  thus  helping 
maintenance  managers  quantify  the  risks  of  postponing  maintenance; 

•  i  d  enti  fy  th e  con d  i  ti  on- mon  i  tor i  n g  measu  rements  that  are  u sef u  I  i  n d  i  cators  of  f ai  I  u  re  i  n 
the  relevant  operating  environment; 

•  risk  of  failure  during  an  upcoming  mission  and  the  dependency  on  mai ntenance  to 
reduce  that  risk; 

•  manning/ support  requirements  of  a  modified  mai  ntenance  policy;  and 

•  spares  required  to  reduce  risk  during  an  upcoming  mission. 

EXAKT  has  a  number  of  assumptions,  including: 

•  the  change  in  system  state  from  'healthy'  to  'failed'  can  be  modelled  as  a  non- 
homogenous  M  arkov2  process; 

•  the  remai  ni  ng  I  ife  of  a  component  or  system  (or  its  likeli  hood  of  fai  I  ure)  i  s  dependent 
on  the  underlying  hazard  function3  and  associated  event  parameters4; 

•  preventive  mai  ntenance  can  assume  that  risk  is  independent  of  age; 

•  decisions  are  only  madeat  discretetime  points; 

•  the  cost  of  fai  lure  exceeds  the  cost  of  preventi  ve  repl  acement; 

•  optimisation  is  based  on  decreasing  the  total  cost  per  unit  time  (in  dollars  or 
equivalent  availability);  and 

•  event  data  can  be  accurately  assigned  to  specific  fai  I  ure  modes. 

EXAKT  also  has  a  number  of  limitations,  including: 

•  engineering  expertise  is  required  to  assign  failure  modes  to  failure  maintenance 
events  and  to  define  diagnostic  indicators  that  are  most  appropriate  for  a  particular 
fai  lure  mode  or  groups  of  fai  lure  modes; 

•  the  PHM  hazard  function  can  only  be  determined  for  failure  modes  that  have 
associated  historical  data.  That  is,  a  fai  I  ure  mode  must  have  occurred  in  the  past  and 
accurate  data  must  be  avail  able  for  modelling;  and 

•  currently,  there  is  a  lack  of  condition  data  and  events  data. 


2  A  Markov  process  isa  discrete-time,  stochastic  process  with  the  Markov  property  (that  is,  future  states  are  independent  of  the  past  states).  The 
present  state  description  fully  captures  all  information  that  can  influence  the  future  evolution  of  the  process. 

3  The  hazard  function  describes  how  the  hazard  (that  is,  risk)  changes  temporally. 

4  Event  parameters  describe  events  that  can  affect  system  condition,  such  as  the  operati  ng  conditions,  running  hours  and  choice  of  maintenance 
activity. 


17 


DSTO-TN-0966 


4.5  Decision  Maker 

Decision  Maker  is  an  objective  decision-making  tool  that  can  be  used  in  most  multi -criteria 
decision-making  problems,  in  particular,  where  a  holistic  approach  isrequired  in  preference 
to  the  subjective  and  ad-hoc  processes  that  are  often  applied  [28,  29]. 

Decision  Maker  helps  ADO  planners  deal  with  the  complexities  of  military  planning  by 
providing  a  sound  scientific  basis  to  assist  in  decision  analysis  in  a  timely  manner,  as  well  as 
providing  thedeci  si  on-maker  with  a  documented  quantifiablejustifi  cation  for  their  decision 
basis.  Examples  where  Decision  Maker  can  be  applied  include: 

•  selecting  the  most  preferred  product,  tender,  service  or  company  that  best  satisfies 
the  specified  requirements,  criteria  or  objectives  (that  is,  in  procurement);  and 

•  ranking  the  performance  of  systems,  components  or  items  using  combinations  of 
several  performance  measurements. 

Uni  ikemost  other  decision-making  products,  Decision  Maker  does  not  use  subjective  criteria 
to  aid  in  the  decision-making  process.  Research  has  indicated  thereis  no  other  softwareon  the 
market  that  incorporates  all  of  the  features  of  Decision  M  aker,  in  particular,  the  use  of  the 
objective  weighted  criteria  method  and  genetic  algorithms  for  sensitivity  analysis.  Other 
features  include: 

•  the  use  of  sophisticated  mathematical  analysis  techniques  to  identify  conflicts  in  data 
input  by  the  user; 

•  non-independent  criteria/  objectives; 

•  a  simplecardinal  ranking  of  alternatives; 

•  removi  ng  thedependency  on  personal  preferences  of  thedeci  si  on-maker,  resulti  ng  i  n 
informed  and  quantifiable  decision  choices; 

•  a  uniquesensitivity  analysis  component  utilising  leading  edgeArtificial  Intelligence 
(A I )  techni ques  to  provi de  analysi s  for  'what  if  situati ons; 

•  a  si  mu  I  ati  on  engi  neto  al  I  ow  deci  si  ons  to  be  model  I  ed  with  uncertai  nti  es  and  tol  erance 
levels  for  criteria; 

•  advanced  graphical  analysis  tools  that  providethe  decision-maker  with  a  means  of 
comparing  alternative  criteria  and  objectives  in  a  meaningful  and  timely  manner; 

•  advanced  simulation  reporting  analysis  in  tabular  and  graphical  format,  providing  a 
means  to  quickly  identify  the  superior  alternative  criteria;  and 

•  graphical  analysi  stools  that  provide  a  means  of  determining  complex  relationships 
and  trends  within  the  criteria/  objective  data. 

Decision  Maker,  the  tool,  assumes  that  the  decision-maker,  the  person,  can  structure  the 
d eci  si  on  probl  em  accord  i  ng  to  the  requ  i  red  p ri  ori  ti  es.  1 1  i  s  not  d esi  gned  to  make  d eci  si  ons  but 
rather,  provides  a  quantitativeanalysis  comparison  of  various  competing  alternatives  to  assist 
personnel  in  short  listing  available  alternatives.  Decision  Maker  does  not  provide  for 
qualitative  input. 

Decision  Maker  allows  for  refined  decisions  by  providing  a  methodological  and  structured 
decision-making  environment,  which  results  in  improved  planning  decisions. 
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4.6  Statistical  Activity  Cost  Analysis  Network  Process  Simulator 

TheStati  sti  cal  A  cti  vity  Cost  A  nalysi  s  (SA  CA )  N  etwork  Process  Si  mu  I  ator  (N  PS)  i  s  a  prototype 
software  tool  that  allows  the  user  to  set  up  and  simulate  complex  process  management 
networks  to  identify  potential,  or  actual,  throughput  problems.  For  example,  modelling  the 
arrival  and  processing  of  work  orders/  workpackagedevelopmentin  an  engineering  support 
organisation. 

A  graphical  point-and-dick  interface  is  used  to  set  up  complex  interconnecting  process 
networks  that  describe  a  workflow  of  interest  with  various  types  of  nodesand  links.Thetool 
then  performs  Monte  Carlo  Simulation  (MCS)  to  generate  realistic  cost  and  timing 
distributions  for  typical  tasks.  In  this  way,  the  user  can  identify: 

•  mean  time  and  cost  for  typical  jobs; 

•  variability  of  time  and  cost  for  typical  jobs;  and 

•  waiting  times  and  queue  lengths  at  individual  nodes  within  the  process. 

Such  process  models  can  identify  bottlenecks  and  areas  that  experience  I  ess  use  in  the  process 
networks  studied.  In  particular,  non-linearities  in  the  network/  system,  where  a  modest 
increase  or  reallocation  of  resources  can  result  in  significantly  higher  throughput,  are  easily 
identified.  Unlike  more  conventional  simulation  tools,  the  N  PS  allows  the  user  to  include 
variability  in  costs  and  durations  at  all  poi ntsinthesimulation.  This  allows,  for  instance,  the 
effects  of  a  more  rel  axed  pol  i  cy  on  turnaround  ti  me  to  be  measured .  The  tool  was  desi  gned  to 
si  mulateprocess  management  within  theAmphibious  and  Afloat  Support  (AAS)  SPO,buthas 
much  broader  applicability  to  other  areas  in  theADO. 

4.7  Mean-Variance  Tool 

The  Markowitz  [30]  mean-variance  model  is  commonly  used  in  the  financial  investment 
i  ndustry  to  sel  ect  portfol  i  os  of  i  nvestment  opti  ons that  provi de  mi  ni  mum  ri  sk  at  given  I evel s 
of  return.  This  technique  has  been  adapted  to  select  minimal  risk  work  packages  for  RAN 
platforms. 

A  simpleto  use  prototype  software  tool  has  been  developed,  using  standard  mean-variance 
concepts,  for  the  optimal  selection  of  RAN  platform  maintenance  and  update/  upgrade  of 
work  packages.  It  is  not  necessary  to  understand  the  mathematics  underpinning  the  mean- 
variance  model  to  use  the  software  tool. 

Operating  the  software  will  require  only  modest  data  entry  and  involves  filling  out  three 
tables: 

1.  a  table  listing  each  'Work  Package'  and  its  associated  upper  and  lower  costs; 

2.  a  table  listing  the 'Mission  Types'  relevant  to  the  platform  and  ranking  the  overall 
i  importance  of  each;  and 

3.  a  table  ranking  the  increase  in  capability  associated  with  each  individual  'Work 
Package'  against  all  relevant 'Mission  Types'. 

A  knowledgeable  individual  would  be  expected  to  be  able  to  enter  the  data,  from  either 
personal  knowledge  or  available  data,  in  less  than  two  hours. 
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A  number  of  reports  will  be  output  from  the  software,  including  agraphical  representation  of 
the  mean-variance  efficient  frontier5  based  on  the  simulation  of  a  large  number  of  random 
portfolios  of  work  package  combinations.  Selection  of  a  set  of  work  packages  that  Neon  the 
efficient  frontier  ensures  the  best  possible  increase  in  capability  given  an  overall  uncertainty 
level  in  costs. 

Advantages  of  the  mean-variance  approach  as  an  aid  to  configuration  management  decision¬ 
making  include: 

•  modest  data  entry; 

•  a  selection  of  work  package  options  from  the  efficient  frontier  lowers  the  risk  in 
funding  a  set  of  sub-optimal  work  package  options; 

•  the  ability  to  maximise  overall  platform  capability  for  a  given  level  offunds; 

•  the  ability  to  minimise  costs  for  a  given  level  of  overall  platform  capability;  and 

•  the  software  and  data  entered  can  be  shared,  hence  making  the  underlying 
assumptions  visible  to  a  group  thereby  leading  to  group  agreement/  consensus  on 
ranking  and  cost  variability  data. 

Furthermore  the  mean-variance  approach  has  the  potential  to  be  extended  to  other 
sustainment  decision-making  areas.  This  includes: 

•  selecting  the  optimal  mix  of  services  to  support  DMO  products;  and 

•  selecting  the  optimal  mix  of  funds  allocation  within  and  between  DMO  products. 


5.  Reporting  Layer 

The  Information  Portal  and  the  Reporting  Portal  allow  for  a  common  interface  between  two 
main  levels  of  the  SMSP.  The  Information  Portal  provides  an  unseen  (to  the  user)  interface 
between  the  analysis  tool  sand  thedatabases.  The  Reporting  Portal  gives  the  users  a  common 
interface,  which  (eventually)  they  would  beableto  customise  to  suit  their  needs.  To  achieve 
the  intent  of  the  SM  SP,  the  Reporting  Portal  needs  to  be  accessible  to  all  levels  within  the 
DMO,  and  RAN,  hierarchies  and  be  customised  to  suit  the  needs  of  each  level.  At  the  top 
level,  the  resources  availableto  the  Reporting  Portal  can  be  utilised  to  contribute  towards 
Product  and  Process  Support  within  the  DMO,  as  shown  in  Figured 

5.1  Reporting  Portal 

The  Reporting  Portal  is  a  web-based  application  designed  to  allow  large  quantities  of 
heterogeneous  information  to  be  grouped,  structured  and  delivered  to  the  desktop  via 
Microsoft  Internet  Explorer.  The  Reporting  Portal  is  fundamentally  a  filing  system  for  both 
traditional  information  (such  as  documents  and  images)  and  dynamic  content  produced  by 
the  analysis  tools.  The  Reporting  Portal  stores  four  kinds  of  data: 

•  actual  content,  consisting  of  static  documents  and  images; 


5  The  effici  ent  frontier  is  where  there  is  the  lowest  risk  for  a  given  level  of  return. 
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•  references  to  content  accessi  bl  e  by  a  U  niform  Resource  Locator  (U  RL); 

•  metadata  descri  bi  ng  content;  and 

•  a  structure  of  linked  'information  contexts'  used  to  generate  the  Reporting  Portal 
navigation  construct. 

The  Reporting  Portal  is  an  Adobe  Flash  application  written  in  Actionscript  2.0.  This  flash 
code  accesses  a  knowledgebase  via  a  web  services  layer  written  in  ASP.NET.  The 
knowledgebase  can  reside  in  any  Object  Linking  and  Embedding,  Database  (OLEDB) 
compliant  database.  The  current  implementation  uses  a  M  icrosoft  Access  database. 

The  focal  point  of  the  Reporting  Portal  is  the  information  contexts,  examples  of  which  are 
show n  i  n  Fi  gu re 9.  A  n  i  nformati  on  context  i  s  anal  ogous  to  a  fi  I  e system  or  emai  I  fol  der  i  n  that 
it  groups  related  information.  For  example,  "F 150  Starboard  Diesel  EngineSensor  Data"  could 
be  considered  a  context  that  groups  all  information  relating  to  instrumentation  sensors 
mounted  on  the  Starboard  Diesel  Engine  of  FIMAS  Anzac.  The  Reporting  Portal  allows 
contexts  to  be  organised  such  that  they  can  have  multiple  'parents'  and  'children'. 
Consequently,  it  differs  from  most  document  management  systems  that  enforce  a  simple 
hierarchical  approach  (that  is,  one  parent  and  multiple  children).  The  advantage  of  the 
Reporting  Portal's  context  is  that  the  contexts  can  be  navigated  in  a  variety  of  ways  and  can 
more  intuitively  accommodatethe  needs  of  a  wide  variety  of  users. 

Figure  10  shows  the  information  context  for  H  MAS  Ballarat.  In  this  context,  the  available 
information  relates  to  the  port  and  starboard  diesel  engines.  These  are  the  children 
information  context  for  the  FI  MAS  Ballarat  information  context.  The  user  may  select  one  of 
these  contexts  to  obtain  information  relating  to  the  diesel  engines.  In  this  examplethe  user  has 
chosen  to  examinethe starboard  diesel  engine(DE2)  turbo  charger  speed,  as  shown  in  Figure 
11. 

1 1  i  s  envi  si  oned  that  the  Reporti  ng  Portal  be  customi  sabl  eto  su  i  t  the  needs  of  vari  ous  I  evel  s  i  n 
the  DMO  and  RAN  chain-of-command.  The  ability  to  customise  the  reporting  feature  will 
allow  for  consistency  across  all  levels  of  reporting.  The  Reporting  Portal  could  assist  Fleet 
Commander  Australia  by  providing  input  into  any  reports  required  by  the  Chief  of  Navy 
Senior  Advisory  Committee  (CN SAC)  regarding  Joint  Capability  Preparedness  combined 
with  input  from  the  Capability  Element  Managers  (CEMs)  and  Force  Group  Commanders. 
The  Reporting  Portal  will  aid  in  ensuring  consistency  between  reports  of  Capability 
Preparedness  and  reports  of  Sustainability. 
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Figure9:  Reporting  Portal  screen  capture  showing  theability  to  service  multiple  platforms 


Figure  10:  R  eporting  Portal  screen  captureshowing  information  contexts  avail  able  for  HM  AS  Ballarat 
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Figure  11:  R eporting Portal  screen  captureshowing  graphical  presentation  for  H M  AS  Ballarat  diesd 
engine  number  two  turbo  charger  speed 

6.  Linking  Sustainment  M  anagement  Support  to  the  FI  C 

and  M  SD  Activities 

Sections  3,  4  and  5  presented  the  suite  of  software  that  contributes  to  the  SM  SP.  Figure  12 
maps  the  relationship  between  the  SMSP  and  theFIC  and  as  can  be  seen  in  the  figure,  the 
SM  SP  contri  butes  to  nearly  every  FI  C.  The  areas  not  supported  are  Organisation,  Collective 
Training  and  People.  However,  these  may  be  supported  within  other  areas  of  the  DSTO, 
which,  as  has  been  stated,  are  outside  the  scope  of  this  report. 

It  must  be  noted  that  tools  such  as  PMAST  do  have  a  People  component,  however  theFIC  - 
People  is  more  concerned  with  'recruiting,  conducting  individual  training,  developing  and 
retaining  the  necessary  people  with  appropriatecoreskills  to  meet  needs'.  The  People  component  of 
PMAST  is  more  closely  aligned  to  ‘appropriate  balance  of  competencies  and  correct  structure  to 
accomplish  its  tasks  and  to  ensure  appropriate  command  and  control',  which  is  a  function  of  FIC  - 
Organisation.  At  the  time  of  writing,  this  aspect  of  PMAST  has  been  proposed  but  not  fully 
implemented  [31]. 

Figure  12  gives  the  impression  of  overlap  between  the  tools  of  the  SMSP.  For  example,  in 
Supplies,  there  is  the  RBDDT,  PMAST,  MAIT  and  the  L  AT.  However,  individual  toolsforma 
constituent  part  of  each  FIC  element,  which  may  then  be  utilised  by  other  tools  contributing  to 
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thatFIC  el  ement  or  another  FI  C  element.  The  combined  output  from  each  tool  withineach  FIC 
ulti mately  contri butes  to  RA  N  capabi I ity  sustai nment  requi rements. 


r 

NAVY  OUTPUT 

OUT  1 

OUT  2 

OUT  3 

Achieve  Navy  Directed 

Achieve  International  Engagment 

Support  Australian  community 

Level  of  Capability 

as  required  by  NIEP  and  PMSA 

and  civilian  authorities  to 

achieve  requiements 

4  4 


REPORTING  PORTAL 


COMMAND  AND  MANAGEMENT 


-T* 


Mean 

Variance 

Optimisation 


Decision 

Maker 


PEOPLE 


Figure  12:  M  apping  Sustainment  M  an  agement  Support  tools  to  the  FIC  and  RA  N  Output 


Aside  from  the  tools  that  contribute  directly  to  the  FIC,  also  included  in  Figure  12  is  the 
Reporting  Portal.  While  the  Reporting  Portal  does  not  directly  contribute  to  any  FIC,  it 
provides  the  important  functionality  of  consolidating  results  and  making  them  easily 
accessibleto  all  levels  of  the  command  and  management  structure,  contributing  to: 

•  balancing  current  and  future  capabi  I  ity; 

•  providing  efficient  and  effective  resource  use;  and 

•  ensuring  clear  and  comprehensive  corporate  governance. 


A  s  stated,  the  N  SP  [4]  i  s  one  method  for  supporti  ng  thedel  i  very  of  N  avy  output  and  i  s  a  short 
to  medium  term  plan.  Even  though  theSMSP  has  been  mapped  against  the  FIC  and  has  a 
forward  capability  planning  functional  ity,  it  also  provides  a  'here-and-now'  functional  ity.  The 
tools  within  the  SMSP  can  also  be  used  to  model  potential  future  acquisition  sustainment 
requirements. 


When  considering  the  functionality  of  the  SMSP  and  the  themes  of  the  NSP,  the  SMSP 
primarily  contributes  towards  the  theme  of  'Prepare  for  Operations',  with  input  also 
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potentially  occurring  in  'Shape our  Future'  and  'Leadership'.  In  particular  the SMSP  would 
contribute  towards: 

•  M  AJ2:  Sustain  in-service  platforms,  equipment  and  systems; 

•  SUP1:  EnsureADF  logistic  systems  support  Navy  activities; 

•  COM2:  Effective  and  efficient  management  of  resources  is  embedded  in  Navy; 

•  COM  7:  Successfully  introduce  new  major  capability;  and 

•  MAJ1:  Acquire  new  equipment. 

All  these  will  ultimately  contribute  towards  the  Navy  Output: 

•  OUT1:  Achieve  Navy  Directed  Level  of  Capability. 

A I  so,  th e  N  SP  i  d  enti  f i  es  r i  sks  associ  ated  w  i  th  each  th erne,  referred  to  as  th e '  N  avy  E  nter p  r i  se 
Risk  Register'.  TheSM  SP  would  provide  input  into  the  management  of  those  risks. 

Figure  13  showstherelationship  between  the  SMSP  and  MSD  functions  (Pol  icy/  Management 
Advice,  Generation  and  Sustainment)  and  sub-functions  (Configuration  Management, 
Engineering,  Inventory  Management,  Warehousing/  Distribution,  Repairand  Maintenance, 
Information  Management  and  Governance^  Enabling)  [32]. 

Note  that  some  of  the  functionality  within  the  SMSP  map  to  two  or  more  MSD  functional 
areas.  In  particular,  these  are: 

•  LAT  -  contributing  to  Inventory  M anagement  and  Warehousing/  Distribution; 

•  MAIT-  contributing  to  Repair  &  Maintenance  and  Information  Management; 

•  LCOO  -  contributing  to  Configuration  Management,  Engineering,  Inventory 
Management,  Warehousing/ Distribution,  Repair  &  Maintenance,  Information 
M  anagement  and  Governance  Enabling;  and 

•  Decision  Maker  -  contributing  to  Policy/ Management  Advice,  Generation  and 
Sustainment  in  the  areas  of  Configuration  Management,  Engineering,  Inventory 
Management,  Warehousing/  Distribution,  Repair  &  Maintenance,  Information 
M  anagement  and  Governance  Enabling. 


7.  Conclusion 

TheSM  SP  presents  an  advanced  analysis  framework  capable  of  predicting  future  sustainment 
requirements.  Itwill  assist  the  SPOs  and  the  RAN  to  makeinformed  decisions  and  thereby 
allocate  available  resources  cost-effectively  in  relation  to  platform  readiness  and 
sustai  nabi  I  ity.  Theoutcomes  wi  1 1  assi  st  i  n  maxi  mi  si  ng  pi  atform  capabi  I  ity  and  thequantitati  ve 
anal  ysi  s  of  capabi  I  ity  management  opti  ons  i  n  rel  ati  on  to  mai  ntenance  and  spari  ng  pol  i  ci  es  for 
a  range  of  operational  scenarios. 

TheSM  SP  provides  the  means  to  perform  cal  culati  ons,  deductionsand  predictions,  in  support 
of  capability  management,  based  on  a  disparate  body  of  facts,  relationships  and  rules.  The 
SMSP  can  be  aligned  with  the  majority  of  theFIC: 
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Categories/Obiectives 


Configuration 

Management 


Engineering 


Inventory 

Management 


Warehousing/ 

Distribution 


Repair  & 
Maintenance 


Information/ 

Management 


Governance/ 
Enabling 

Policy/Management  Advice  Generation  Sustainment 

Figurel3:Therelationship  between  theSM  SP  andM  SD  functions,  which  are  listed  along  both  axes  of 
the  graph  [32] 

•  Command  and  M  anagement; 

•  M  ajor  Systems; 

•  Supplies; 

•  Support;  and 

•  Facilities. 

In  so  doing,  theSM  SP  will  encompass  much  of  MSD's  activity  requirements  that  contributeto 
areas  of: 

•  Configuration  Management; 

•  Engineering; 

•  Repai  r  and  M  ai  ntenance; 

•  I  nventory  M  anagement; 

•  Warehousing  and  Distribution; 

•  I  nformati  on  M  anagement;  and 

•  Governance  and  Enabling. 

The  I  nformati  on  Portal  will  ensure  quality  data  input  and  the  Reporting  Portal  will  provide 
consi  stency,  ti  mel  i  ness  and  ease  of  reporti  ng  and  will  i  nd  ude  a  reporti  ng  functi  onal  ity  that 
can  be  customised  to  the  needs  of  all  levels  in  the  chain  of  command. 
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Itcan  be  seen  in  Figure  13  that  the  SMSP  contributes  to  all  MSD  functional  areas  and  therefore 
the  SM  SP  contri  butes  towards  the  DMO  purpose  and  goal  s.  That  i  s,  the  SM  SP  w  i  1 1  assi  st  M  SD 
reduce  LCOO  of  maritime  platforms.  To  achieve  this,  the  suite  of  software  tools  described 
within  the  body  of  this  report  is  required  and  it  is  essential  that  those  tools  utilise  the  same 
data  sources  and  uniformly  report  their  results.  The  SM  SP  provides  the  required  common 
framework. 

The  potential  financial  savings  that  will  be  realised  when  the  suite  of  software  tools  is 
implemented  and  operational  is  difficult  to  estimate.  However,  non-financial  benefits  include: 
improved  governance  and  accountability;  improved  capability  management,  particularly  in 
the  reliability,  maintenance  and  support  of  platforms  and  systems;  and  improvements  in 
workforce  effi  ci  ency . 
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